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■ It is well known that the nonlinear filtering problem has important applications in both military and 

commercial industries. The central problem of nonlinear filtering is to solve the Duncan-Mortensen- 

u 
o 

> 



Zakai (DMZ) equation in real time and in a memoryless manner. In this paper, we will show that 
under very mild conditions (which essentially say that the growth of the observation is faster than the 
growth of the drift), the unique nonnegative weak solution of the most general DMZ equation can 
be approximated by the solution to that restricted on a large ball with Dirichlet boundary condition. 
The error of this approximation tends to zero exponentially as the radius of the ball tends to infinity. 

■ Moreover, the numerical solution on the large ball can be efficiently obtained by Yau-Yau's algorithm, 

■ which depends only on solving the observation-independent Kobnogorov forward equation on each time 
step. Equally important, we show that the numerical solution obtained by Yau-Yau's algorithm converges 



od 



to the solution restricted on the large ball in the sense, and a precise convergence estimate is given. 



. Numerical simulation to ID cubic sensor is illustrated at the end. 

>■ 

■ I. Introduction 

rS 

I The Kalman filters have been widely used in many areas such as navigational and guidance 

systems, radar tracking, solar mapping, and satellite orbit determination. However, they are 
limited to where the linearity assumptions of the drift term and observation term are satisfied, 
as well as that the Gaussian assumption of initial value is required. In practice, the nonlinear 
drift/observation terms enter to the modeling naturally, say the cubic sensor. Therefore, it is 
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necessary and interesting to solve the nonlinear filtering problems. By "solving" a nonlinear 
filtering problem, it is to determine the conditional density p{x, t) of the stochastic process Xt, 
named the state, given the observation history {y^: ^ s ^ t}, another stochastic process 
related to Xf,. In the late 1960s, Duncan [2J, Mortensen [|51 and Zakai [fTOl independently derived 
the Duncan-Mortensen-Zakai (DMZ) equation, which the conditional probability density p{x, t) 
satisfy. Henceforth, the central problem in nonlinear filtering theory is to solve the DMZ equation 
in real time and memoryless way. 

In this paper, we consider the nonlinear filtering problem based on the signal observation 
model 

dxt = f{xt, t)dt + G{xt, t)dvt, 

(1.1) 

dyt = h{xt,t)dt + dwt, 

where Xt and / are n-vectors, G is an n x r matrix, and Vt is an r-vector Brownian motion 
process with EldvidyJ] = Q{t)dt, yt and h are m- vectors and wt is an m- vector Brownian 
motion process with E[dwtdw-[] = S{t)dt and S{t) > 0. We refer to Xt as the state of the 
system at time t with xq satisfying some distribution and yt as the observation at time t with 
yo = 0. We assume that {vt,t > 0}, {wt,t > 0} and Xq are independent. 

The unnormalized density function a(x, t) of Xt conditioned on the observation history Yt = 
{ys : < s < t}, at least formally, satisfies the DMZ equation 

da{x, t) = La{x, t)dt + cr(x, t)h^{x, t)S~^{t)dyt 

(1.2) 

ct(x,0) = cro{x), 

in which ao{x) is the probability density of the initial state xq, and 

i,j = l ■' «=1 

The DMZ equation (11.21) is a stochastic partial differential equation due to the term dyt. There is 
no easy way to derive a recursive algorithm for solving this equation. In real applications, one 
may be more interested in constructing robust state estimators from observed sample paths with 
some property of robustness. For each "given" observation, making an invertible exponential 
transformation [|71 

(T(x,t) =exp[/i^(x,t)^-^(t)2/t]p(x,t), (1.4) 



March 20, 2012 



DRAFT 



3 



the DMZ equation is transformed into a deterministic partial differential equation with stochastic 
coefficients, which we will refer as the "pathwise-robust" DMZ equation 



= exp {-h^S ^yt) 
p(x,0) = CTo(x). 



L--h^S-^h 
2 



[exp{h^S ^yt)p{x,t)] 



(1.5) 



Or equivalently, 



^{x,t) = ^Dlp{x,t) + F{x,t) ■ Vp{x,t) + J{x,t)p{x,t) 
p{x,0) = cro(x), 



(1.6) 



where 



Dl=J2{GQG' 



n 



dx j dx j 



F{x,t) 
J{x,t) 



j=i J j=i ] 



(1.7) 
(1.8) 



n 



d 



dK 



1 " 



dKdK 

+ 



dxidxj dxi dxj 



n r\ p n 



i=l 



' dxi 



where 



K{x,t) = h^{x,t)S'\t)yt. 



(1.9) 



(1.10) 



The exact solution to (11.51) or (11.61 ). generally speaking, doesn't have a closed form. Hence, 
many mathematicians pay their effort on seeking an efficient algorithm to construct a good 
approximate solution. One of the direction is the splitting-up method to the DMZ equation, 
which is first introduced by Besoussan, Glowinski, and Rascanu [HI. Their method is limited to 
bounded drift term and observation term. Yau and Yau |l9l developed a novel algorithm to the 
robust DMZ equation, which get rid of the boundedness of drift term and observation term to 
some mild growth conditions. They proved that the unique nonnegative solution of the robust 
DMZ equation can be approximated by that restricted on a large ball with Dirichlet boundary 
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condition. However, they only show their algorithm works well where the drift/observation terms 
don't have explicit dependence on time t and the noises are all white. 

In this paper, we will extend Yau-Yau's algorithm to the most general setting of the robust DMZ 
equation. We will not only give the theoretic error estimates, but also illustrate the numerical 
simulation to support our theoretic results. The difficulties are two folds: on one hand, the 
existence and uniqueness of the robust DMZ equation in the most general setting hasn't been 
established yet. The well-posedness of the robust DMZ equation, under some conditions, has 
been investigated by BUl, etc.; on the other hand, the most general setting introduced 

more terms which leads to much more involved computations and analysis. 

Let Pfc = {0 = To < Ti < • • ■ < Tfc = T} be a partition of [0, T]. Let pi be a solution of the 
robust DMZ equation with yt freezed at t = Tj_i, for rj_i < t < Ti, i = 1,2, k 



L--h^S-^h 
2 



[exp {h^S ^i/r.„i) piix,t)] 



(1.11) 



= exp {-h^S ^yr,_^) 
piix,0) = cro(x), 

or 

pi{x,Ti^i) = pi^i{x,Ti_i), for i = 2,3, - ■ ■ ,k. 

Define the norm of the partition Vk by \Vk\ = sup^<j<;j(rj — ri_i). Intuitively, as \Vk\ 0, we 
have 

k 

'^X[T,^ur^]{t)pi{x,t) p{x,t) 
1=1 

in some sense, for all < t < T, where p{x, t) is the solution of the robust DMZ equation (11.51 ) 
or (fTel) . 

The proposition below helps to shift the computations off-line. This is the key ingredient of 
Yau-Yau's algorithm. 

Proposition 1.1: For each Xj-i < t < Ti, i = 1,2, ■■ ■ ,k, pi{x, t) satisfies (11.111) if and only if 

Ui{x,t) = exp [h^ {x,t)S'^{t)yr,_^]pi{x,t), (1-12) 



satisfies the Kolmogorov forward equation 

du 

at 



^{x,t)= (L-^-k'S-^h\u,{x,t), (1.13) 
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where L is defined in (I1.3I ). 

To be more specific, how to shift the computations off-line. Let us consider the initial data 
to Kolmogorov forward equation (11.131) as a set of complete orthonormal base in Li^iW'), 
say {4>i{x)}^^. For arbitrary initial condition Mi(x,rj_i) G L^(M"), it can be represented as 
Uj(a;,Tj_i) = Yl^=i^i,n(f>n{x). Supposc the operator (L — S^^h) generates a Co-semigroup 
(under some conditions), denoted as S{t). Hence, the solution to (11.131 ) with the initial condition 
Mj(x,Ti_i) can be expressed as 

oo 

Ui{x,Ti) =S{Ti - Ti_i)Ui{x,n_i) = '^Ui^n<S{Ti -ri_i)0„(x), 

n=l 

where 5(rj — rj_i)0„(x) can be computed off-line. 

Next, we specify the observation updates (the initial condition of (11.131) ) for each time step. 
For < t < Ti, the initial condition is ui{x, 0) = ao{x). At time t = ti, 

pi{x,Ti) =exp [-h'^{x,Ti)S'^{Ti)yo\ui{x,ri), 
by (11.121) . Combined with (11.111 ). we have 

p2{x,Ti) = exp [-h^{x,Ti)S'^{Ti)yo\ui{x,Ti). 
Now that the observation y-j-^ is available, the prediction ui{x,ti) can be updated as: 

U2{x,Ti) = exp [h'^{x,Ti)S~^{Ti)yr^]p2{x,Ti) = exp [h^{x,Ti)S'^{Ti)yr^]ui{x,Ti). 

This is the initial condition in the next time interval ti < t < T2. Recursively, the initial condition 

for Tj_i < t < Tj is 

Ui{x, Ti„i) = exp {hF'{x, Ti_i)S~^{Ti_i){y-r^_^ - y^^_J]wi_i(2;, r^.i), (1.14) 
for z = 2, 3, ■ ■ ■ , fc. The approximation of p{x, t), denoted as p{x, t), is obtained 

k 

Pix,t) =^X[n^un]{t)pi{x,t), (1.15) 

i=l 

where Pi{x, t) is obtained by (11.121) . Furthermore, we could recover the approximation of a(x, t) 
by (|1.4I) . Till now, we have briefly described Yau-Yau's algorithm. A natural question comes to 
us: If we applied this algorithm to the most general setting of DMZ equation (11.51) or (11.61) . then 

is p{x,t) a good approximation of p{x,t), for {x,t) e M" x [0,T], as \Vk\ —^0?lfitis, 

then in what sense? 
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To answer this question, we divide it into two steps: first, we show that the density restricted 
in a bounded domain fi G M", denoted as p^, can be well approximated by gluing up the 
piecewise approximation p^, similarly obtained as (11.151 ); next, it is left to show that is a 
good approximation of p in M". 

The first step is accomplished by the theorem below: 

Theorem 1.1: Let fi be a bounded domain in M". Assume that 

1) \N{x,t)\<C, (1.16) 

2) There exists some a G (0,1), such that 

\N{x,t) - N{x,t;t)\ <C\t-t\", (1.17) 

for all {x,t) G fi X [0,T], i G [0,T], where 

Nix, t) ^ {h^'S-') yt - \dIK + ]^D^K .VK-f-VK-]^ (h^S-'h) , (1.18) 

and N{x,t;t) denotes the observation yt contained in N{x,t) be freezed at yj. Let pQ{x,t) be 
the solution of (fTel) on fi x [0,T]: 

^ " ^) + ^(^' ■ Vpn(x, t) + J(x, t)pn(a:, t) 

pnix,0) = ao,nix) (1-19) 

, Pn(a^,t)|an = 0, 

where D^, F{x,t) and J{x,t) are defined in (|1.7| )- (|1.9I ) and cro,n is defined as 

{(To(x), X G fie 

(1.20) 
0, xe M" \ fi, 

where fi^ = {x G fi : dist(x, 9fi) > e}. 

For any < r < T, let Vk = {0 = tq < ti < T2 < ■ ■ ■ < = t} he a partition of [0, r], 
where Xj = ^. Let Pi^n{x,t) be the solution on fi x [rj_i,rj] of the equation 

—^{x,t) = -Dlpi^n{x,t) + F{x,t]Ti_i) ■ Vpi^n{x,t) + J{x,t;Ti_i)pi^n{x,t) 

Pi,nix, Ti^i) = Pi_i,n(x, Ti_i) (1-21) 

, Pi,n{^,t)\dn = 0, 
for 2 = 1, 2, ■ ■ ■ , /c, with the convention that pi^n{x, 0) = 0-0 ^(2;). Then 

pn{x,T) = lim pfc,n(x,r), 
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in the sense in space and the following estimate holds: 

\pn-Pk,n\{x,r)<C^, (1.22) 

where C = C{T, ao,n) is a generic constant. The right-hand side of (| 1.221) tends to zero as 
k — i- oo. 

The following theorem verifies that pq, n = Bji, is a good approximation of p, provided that 
R is sufficiently large. 

Theorem 1.2: For any T > 0, let p{x, t) be a solution of the robust DMZ equation (|1.6I) in 
X [0,T]. Assume the following conditions are satisfied, for all {x,t) G M" x [0,T]: 

1) Ar(x,t) + |n||G'gG'^||^ + |/-D^K| <C, (1.23) 

2) e-v/i+^ [I4n | |GQG^| |^ + 4 |/ - D^K\\ < C, (1.24) 
where C, C are constants possibly depending on T. Let 1 and pR be the solution to the 
robust DMZ equation (fTel) on the ball Si?: 

^(x,t) = ^D^pij(x,)f:) + F{x,t)VpR{x,t) + J{x,t)pR{x,t) 

PR{x,0) = ao,R{x) ^^-2^^ 

[ Pr{x, t) = for (x, t) e OBr X [0, T], 

where F(x, t), J(x, t) and ctq,/? are defined as (11.81) . (11.91 ) and (11.201) . respectively. Let v = p—pR. 
Then i; > for all (x, t) e BrX [0, T] and 

/ (f)v{x,T)<Ce~^ [ eV^^+^cTo(x), (1.26) 

where C = C{T) is a generic constant and <p{x) = e~^[(l^l^/^^~^)^+^] — e"^. In particular, 

/ v{x,T)<Ce-^'^ [ e^y^aoix), (1.27) 

where C = C(T). 

Also, some interesting properties of the density function have been discovered. For example, 
the growth rate of the density function in a fixed large ball with respect to time (Proposition 
13.21) : the decaying rate of the density outside a large ball with respect to the radius (Theorem 
13.41) : the lower bound of the density function inside a large ball in terms of time (Theorem 15.51) . 
etc. 
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This paper is organized as following: section II is the preliminary and the statement of the well- 
posedness of the robust DMZ equation, whose proof is left in appendix; the proof of Theorem 
11.21 and Theorem 13.41 are presented in section III; section IV is devoted to the proof of Theorem 
11.11 Theorem 15.51 can be found in section V and the numerical simulations of ID cubic sensor 
are illustrated in section VI. 

II. Preliminary 

Let Qt = X [0,T]. Assume that the following conditions hold for the entire paper: 

(1) The operator L defined in (11.31) is a uniform elliptic operator and it is bounded from 
above on Q^-, i.e. there exists constants A > such that 

n 

for any (x, t) E Qt, for any ^ = (^i, ■ ■ ■ , e„) G M". And 

\\GQG^\\oo= sup IGQG^loo < 00, 

where | ■ |oo is the sup-norm of the matrix. 

(2) The initial density function cro(x) G //^(M") decays fast enough. To be more specific, 
we require that 

eV^aoix) < 00. 

A. Existence and uniqueness of the nonnegative weak solution 

Let H^(W') be the space of the functions with their gradient and themselves are square 
integrable. It equips the norm 

IL,/'^M|2 _ / /„,2 I |V7 „,\2 



u + \Vxu\ )dx. 

Let H^'^{Qt) be the subspace of H^iW') for each time t > and its derivative with respect to 
t is also square integrable. The norm is defined as 

\\v{x,t)\\l.^ = I {y"^ + + \dtv\'^)dxdt. 

Jqt 

It is well known |[8l that H^{W^) and H^'^^Qt) are complete. It can be shown that under 
some mild conditions, the existence and uniqueness of a nonnegative weak solution to the DMZ 
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equation (11.61) on M" x [0,T] have been guaranteed. We state the theorems here and leave the 
proofs in the Appendix. 

Theorem 2.3: Under the condition (l)-(2) and the condition (|A.1|) - (|A.5I) in Theorem I A. 11 the 
robust DMZ equation (11.61) on with the initial value (Tq ^ H^(W^') admits a nonnegative 
weak solution. Assume further that for some c > 0, 



sup / e"' p^{x,t)dx < oo, 

d<t<T Jk" 



0<t<T . 

and 

\V p{x,t)fdxdt < oo, 

where r = \x\. Suppose that there exists a finite number a > such that 

2J(x, t) - -^[cD^r - {F{x, t) + F{x, t))]^ < a, (2.1) 
4Ai 

for all (x,t) G Qt, where Ai is the smallest eigenvalue of the matrix {GQG'^), 

dK 



F{x,t) 



(2.2) 



i=l 



and J{x,t) is defined as in (11.91 ). Then the weak solution p{x,t) of the robust DMZ equation 
on Qt is unique. 

B. Technical lemma 

In the proofs of the theorems, we will repeatedly adopt the following lemma with suitable 
chosen test functions. We'd like to prove the lemma here. 

Lemma 2.1: Assume that pn satisfies the robust DMZ equation (11.61) on some bounded domain 
n G M", for < t < T. Then, for any test function tjj{x) G C°°(i7) (for concise notation, we 
omit the subscript below), we have 



J I ijp=^ I Dli;p+ I (f-D^K)-V^p+ I ijpN 

t/f^ t/S^ •/f^ 



+ -/ ^{D^p.y)-- p(D^^.^) + -/ ^pY^ {^GQG^)^^v, 

+ \ ^p{D^K-v)- I ijp{f-iy), (2.3) 
Jan Jan 
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where u = (z^i, 1^2, ■ ■ ■ i^n) is the exterior normal vector of VL, 

d* 



dxi 



(2.4) 



i=l 



and D^, N and K are defined in (fTTTI) . (11.181) and (II.IOL respectively. 

Remark 2.1: We don't specify the test function on the boundary 5^7. All the boundary 
terms in (|2.3I) are kept. However, in the proofs of the theorems, all the boundary terms are 
vanishing by choosing the test function ip in Lemma 12.11 properly. 

Proof: Multiplying ip{x) on both sides of the robust DMZ equation (|1.6I) and integrating over 
the domain yields 



^Dlp + F{x,t)-Vp + J{x,t)p 



(2.5) 



where F{x, t) and J{x, t) are defined in (|1.8I) and (11.91) . respectively. Apply integration by parts 
to the first two terms on the right-hand side of (|2.5I) : 



E 



(G0G^.^,p + 2/X:|^^(G0G-)„p 

^ i,7 = l 



WE 



92 



dx 2 dx J 



{GQG^)^^i;p 



+ f^± {GQG-), ^n-j P±^ (GQG-)^^ 
Jan . f^a^j Vsf^ . .^^ Ox^ 

n 



I . VP ^ - t It^l^ iGQG% p - 1 1 ^ (GQG^, 



(2.6) 



air 



•^dn j^j^i j Jdn ij^i 

Jan 



(2.7) 



Substituting (12.61) and (|2.7I) back into (12.51) . (|2.3I) is obtained by written in compact notations. □ 
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III. Reduction of the problem to the bounded domain case 

In this section we shall prove that the solution p to the robust DMZ equation (11.61 ) in M" 
can be well approximated by the solution of (11.251) in a large ball Br. Moreover, the error 
estimate with respect to the radius R is given explicitly in the sense. Let C, C and C denote 
the generic constants, which may differ from line to line. 

We first show an interesting proposition, which reflects how the density function in the large 
ball changing with respect to time. It is also an important ingredient in estimating the error. 

Proposition 3.2: For any T > 0, let pr{x, t) be a solution of the robust DMZ equation (11.191 ) 
with VL = Bji and < t < T. Assume that condition (11.231) is satisfied. Then 

eV^PR{x,t)<e^' f e'/^aoix). (3.1) 



Proof: Choose the test function in Lemma fUl ib = e'^^ , where 0i G C°°{Br), Br = {x G 
: < R}. Let pR be the solution of the robust DMZ equation (11.251) on the baU Br. By 

Lemma [2711 we have 

d 



dt 



e^'PR 



Br 



e'^'PR 



Br 



+ \f e^^iD^pR-u). 



(3.2) 

All the boundary integrations in (12.31) . except the first term, vanishes, since pijjan = 0. Moreover, 
recall that p/? > in Br and vanishes on dBR implies that ^las^ < 0. Hence, on BBr, 



[D^Pr -1^) = ^ 



i=l 



.i=i . 



dpR 
dr 



J2 (GQG' 



II] 



< 0, 



by the positive definite assumption of (GQG^). Thus, (13.21) can be reduced further 



Choose (pi{x) = 
one by one: 



{Dl(P, + D^(j), ■ V0i) + (/ - D^K) ■ V01 + 



(3.3) 



a/1 + Ixp and estimate the terms containing on the right-hand side of (|3.2I) 

n 

Dlcp, = J: [GQG-)^^ - J: {GQG-) 

i=l 

<||GQG^|| . ^== + 



n 



l + \x\ 



n\x\ 



'1 + X 



D^c^, ■ = (GQG-)^^ < \\GQG-\ 



(1+ |x|2) 



< 2n\\GQG 



Tl 



En 
i,j=l ^i^j 

1+ bp 



<n\\GQO 



(3.4) 
(3.5) 
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and 



\{f-D^K)-V<Pi\ < \f-D^K\ 





x\ 









< \f-D^K\, 



(3.6) 



where | ■ | is the Euclidean norm. Substitute the estimate (I3.4I) - (I3.6I) back into (|3.3I) . we get 



by condition (11.231 ). Hence, 



-n\\GQG^\\ 



\f-D^K\+N 



< C / e^-pR, 

'Br 



e^'pR{x,t) < e^* / e'''pnix,0) < e^* / e*V(x, 0) = e^* / e<^Vo(a;), 

Br JBr 7iR" JM" 

for < t < T. □ 
We are ready to show that the solution pr to (11.251) on Br is a good approximation of the 
solution p on M". 

Proof of Theorem ll.2t By the maximum principle (cf. Theorem 1, p. 34 in Friedman's book 
Bl), we have v = p - pr > for (x, t) E BrX [0, T], since v\dBR > for < t < T. Let ^ in 
Lemma 12.11 as 

g{x) = e-'^^(^) - e-^, 

where 02 is a radial symmetric function such that 02 (a;)!^^^ = R, V02|aB^ = and 02 is 
increasing in \x\. Hence, qIqer = and VqIqer = 0. Apply Lemma [2?n to v, taking the place 
of Pr, with the test function -ip = g, we have 



dt 



gv = V 

Br J Br 



-Dlg+{f-D^K)-Vg+gN 



v!^ (D^02 . V02 - D^02) - e-*' (/ - D^K) ■ V02 + gN^ 



vg 



-^Dl^2 + \d^^^ ■ V02 - (/ - D^K) ■ V02 + iV 



+ e " / e 

'Br 



^v/^ (-^^^02 + \d^4>2 ■ V02 - (/ - D^K) ■ V02) 



vgli + e " / e 



Let us choose 02(2:) to be 02(x) = Rd(^-^), where "d^x) = 1 — (1 — x)"^. It is easy to check 
that 02 (x) satisfies all the conditions we mentioned before. Direct computations yield, for any 
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X e Br, R » 1, 



< \ \GQG^ 



6n\x 



i?3 



i=l 



\X\ 



\X\ 



2x2 n 



4xj 4xj 



Tl 



and 



\{f-D^K)-V(t>2\ 



<4|/-D^ir|. 



(3.7) 



(3.8) 



(3.9) 



It follows that 



sup|Ii| < 14n||GQG''^|| +4\f - D^K\ + N < C, 

Br 



by condition (11.231 ). Similarly, 

sup II2I < sup 

Br Br 



e-V^ (I4n \\GQG^\\ + 4 |/ - D^K\) 



<C, 



by condition (11.241) . In the view of Proposition 13. 2[ one gets 

d 



^ I gv<C I gv + e'^C / eV^^+^p <G I qv + e 

dt J Br J Br J Br J Br 



-R 



(3.10) 



Multiply e on both sides of (13.101) yields 

d_ 

dt 



J Br J JM" 



Integrate from to T and multiply e^^ on both sides gives us 



gv{x,T) < \\v{x,0)\\ooe^'^ I gdx + 



Br 



Br 



-R+CT, 



C ev^ao(x), 



where v{x, 0) = ctq — o"o,_r. Recall that q{x) = e ^[ '^'^ — e \x\ < R, we estimate 

[ Q< f (1 - e"^) < CR" 

J Br J Br 



and 



/ gv{x,T)> [ (e-''H^^'^'''-'M-e-Avix.T)>-e-^en [ v{x,T). 

J Br Jbr\ J Jbr 
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It is easy to see that \ \v{x, 0)\\oo S ^ C{n)tR^ is arbitrarily small, since e is independent of 
R. It yields that 

/ vix,T)<Ce-Te^ [ e^y^aoix), (1.28) 

J Br JM" 

where C is a generic constant, which depends on T. □ 
By refining the proofs of Proposition 13.21 and Theorem II. 2[ we obtain an interesting property 

of the density function p{x,t). It asserts that p captures almost all the density in a large ball. 

And we could give an precise estimate of the density outside the large ball. 

Theorem 3.4: Let p{x, t) be a solution of the robust DMZ equation (|1.6I) in Qy. Assume that 

1) Condition (11.231) is satisfied; 

2) A stronger version of condition (11.241) is valid. To be more precise, 

e-hV^+^ [lQn\\GQG^\\^+ A\f - D^K\\ <C, (3.11) 

for all {x,t) E Qt- 

Then 

f p{x,T)<Ce-"^^^ [ e^y^aoix), (3.12) 

J\x\>R Jr" 

where C is a generic constant, which depends on T. 

Proof: Let f = p — as in the proof of Theorem 11.21 By the maximum principle, we have 
that V >0 for all (x, t) G Bji x [0, T]. Choose the test function ip in Lemma 12.11 as 

$(a;) = j{x)g{x), 

where 7(2;) = e^"^^*^^-' and 0i(x), g{x) are defined in the proof of Proposition 13.21 and Theorem 
11.21 It follows directly that $1^^^ = Vx^Isbr = 0, by the fact that qIobr = "^qIobr = 0. Apply 
Lemma [ZTI to v taking place of pR with the test function $, we have 

^ [ ^v = \ f Dl^v + / (/ - D^K) / <^Nv 

at J Br ^ J Br J Br J Br 

= \ I (DllQ + '^D^l ■ + iDIq)v + [ if- D^K) ■ {V^g + -fVg)v 

J Br J Br 



'Br 
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All the boundary integrations vanish due to the similar arguments in Theorem |1.2[ Direct 
computations with 7(x) = e^'^'^^^^ and g{x) = e"*^^^^^ — e^^ by hand give us 



d 
It 











f 


( 




J Br 





-e--^^ [Diet), + -D^(t)i ■ V01 J Q - e2<?^D^0i ■ e-<^^ V02 
+ 7e-<^^ {D^(t>2 ■ V02 - Dlci)2) 
+ [ [f-D.^K)-(]-ey^V(PiQ--ie-^'V(t)^v+f jgNv 

J Br \^ / J Br 

j^^v (^Dlct)^ + iD^</>i ■ V0i^ - i^^^i ■ V02 + ^ {D^(t)2 ■ V02 - Dlct)^) 



+(/ - D^K) ■ (-V01 - V(/)2) + iV 



+ e 



7^; 



■ V(/)2 + ^ (I?«,02 ■ V02 - Dl(t)2) - (/ - D^K) ■ V02 



<l>t;[l3] + e-^/ 7f[l4], 



By the similar estimates (l34l)-(ll!6l). (l377l)-(II!9l). we have 



1 < 17n 


\GQG'^\\ 


1 < 16n 


\GQG^\\ 



A\f-D^K\. 



Hence, 

d 



"^ -'Sfl J Br J Br 



Br 
J Br 



Br 



Br 



Br 



-R+Ct 



Br 



e^^ao(x) 



by condition (11.231) . (11.241) and (13.11) . By the similar argument in the proof of Theorem II. 2[ 
where we get the estimate of /g^ gv, we have 

[ ^v{x,T)<Ce-^ f ev/^+^(To(x), (3.13) 

J Br Jr" 

where C is a generic constant, which depends on T. Recall that g{x) = e~^[~*^l^l^/^^~^)^+^l — e^^, 
it implies that 

^v{x,T) > ^e-Te^ I -fv{x,T). (3.14) 



Ib, 



Br 
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Combine (13.131) and (13.141 ). we obtain that 

Jbh Jr" 

"2" 

This implies that 

[ ^p{x,T)< [ 7pK(^,r) + Ce-A« /" eV^ao{x)<C{l + e-TS^) [ e^^ao( 

J Br J Br JR" jR" 

? "2" 

by (I3l1) . Let R ^ oo, 

[ ^p{x,T)<C [ eV^aoix). 

JR" JR" 

Consider the integration outside the large ball Bji, 



p{x,T) < / jp{x,T) < C I ev/^ao(x). 

\x\>R J\x\>R 



Therefore, we achieve the conclusion that 



J\x\>R JR" 



X). 



□ 



IV. CONVERGENCE 

In this section, we shall show that our algorithm will yield an convergence for bounded 
domain, i.e. p/j(x, r) = limfc_>.oo Pk,R{x, r), for < r < T, in the sense. For the convenience 
of the reader, we state the technique lemma will be used in the proof of Theorem 11.11 below. 

Lemma 4.2: (Lemma 4.1, [9J) Let i7 be a bounded domain in and let u : ^7 x [0, T] — )■ M be 
a function. Assume that v{x, t) = for (x, t) e dilx [0, T]. Let = {x G : v{x, t) > 0}. 
Then 

— / V{x,t) = / -7^{x,t), 

for almost all t G [0,T]. 

Proof of Theorem 11.11 : For the sake of brief notation, we omit the subscript Vt for and 
Pi^n henceforth. Let fi^ = {x eVL : p{x, t) — pi{x, t) > 0}. Apply Lemma [XTI to (p — pi) taking 
place of pij, with the test function = 1, we have 

d 

dt Jn+ Jn+ Jn^ 



{p-p^)< {p-p^)N+ p^[N-N{-,r,_,)], (4.1) 
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by Lemma I4T21 All the boundary integrations, except D^{p — pi) ■ u, vanish, since (p — 

Pi)\dnf ~ 0- Moreover, D^^p — Pi) ■ u < due to the similar argument in Proposition I3.2[ 

where Jq^^ D^p ■ u < 0. Combine the conditions (11.161 ) and (11.171 ), (14.11) can be controlled by 

d 
dt 

To estimate J^p, we apply Lemma \27\] to p, with the test function tjj = 1, we get 



ip-p.)<C / (p-p,) + C(t-r,_ir / p. 
f7+ Jn+ Jn 



(4.2) 



jj P< I pN<C I p, 



n Jn 



which implies 



[ P<C [ ^0,^ 
Jn Jn 



(4.3) 



where C is a generic constant, depending on T, for all < t < T. Thus, 

jj y-Pi)<C !{p- p{) + C{t - n^,r [ ^o,n. 
Multiply e-c'(*-'^i-i) on both sides and integrate from rj_i to t, we get 

\p - pi)yx, Ti^ij -h o 

'n+. , 

' I — 1 



{p-Pi){x,t)<e^^'-^^-^^ / (p-p,)(x,r,_i) + C^ 
n+ Jn+ l + a 



where C is a constant, which depends on T, ctq q. Similarly, one can also get that 



(p. - p){x,t) < e^(*-^-^) / (p, - p)(x,r,_i) + C 



l + a 



l+a 



Consequently, we have 

\p~Pi\{x,t) <e^(*--i) 



<e 



p- Pi (x,ri_i) + C — 

n l + a 

p- Pi-l\[x,Ti_i) + C — 

n l + a 



(4.4) 



since pi(x, ri_i) = Pi-i{x, Tj-i), for z = 1, 2, ■ ■ ■ , A;. Applying (14.41) recursively, we obtain 



\p- Pk\{x,Tk) <e 



C(Tfc— Tfe_l) 



n 



p-pfc-i|(x,rfc_i) + C- 
o l + a 



<e'^'^ / |p-po|(x,0) 
n 

C 



+ ^— [(rfc-rfc_i)i+"e 
i + a 

+ --- + (ri-ro)^+"e'5(^'=-^°) 



+ e""" + ■ ■ ■ + e'"^ ] < — 
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where C is a constant, which depends on a, T and Oq^q. It is clear that j^\p — pk\ — ^ 0, as 
k ^ oo. □ 



V. Lower bound estimate of density function 
Theorem 5.5: Let pR be the solution of (11.251) . the robust DMZ equation on Br. Assume that 

1) f{x,t) and h{x,t) have at most polynomial growth in \x\, for all t G [0,T]; 

2) For any < t < T, there exists positive integer m and positive constants C and C" 
independent of R such that the following two inequalities hold on W: 



i r 

(a) - \nm[m 



2) 1 1 GQG^ 1 1 ^ + m Tr (GQG^) ] 
+ N{x,t) > -C- 



(/ - D^K) ■ X 

(5.1) 



(b) 



-mi:r{GQG^) 



im-2 



~m{f - Du,K) ■ x\xr-^\ < -nm{m + 1) \\GQG 



\X 



2m- 2 



+ G", 



(5.2) 



where Tr(*) is the trace of *. 
3) Condition (11.161) is satisfied. 
Then for any Rq < R, 

CPr{x,T) 

^{C-C')T-R^ 

C' 

-C'T 



> 



+ e 



-nm{m + l)\\GQG''\\^Rl"^-' + C"j (l - 
Cc^o,i?(a;), 



,c"r 



Br 



Br,, 



where C{x) = e-«(^) - e"«(^o), C{x) = Ix]"". 

In particular, the solution p of the robust DMZ equation (11.51) on M" has the estimate 



/ e-N'"p(x,r)>e-^'^ [ e-N^aol 



Proof: Apply Lemma f2A\ to pr with the test function ^jj to he ( = e ^^^^ — e where ^{x) 

is an increasing function in we have 



Jt I 

"'^ 'Br^ 



PR 



Br,, 



-DlC + {f-D^K)-VC + CN 
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All the boundary integrations vanish, since C,\aBR = PbIbbr = ^- Direct computations yield that 



pRe 



2 r2 



(/ - D^K) ■ X 



r(r) 



+ / CPij 



^i^a ■ ve - ^i?^? - (/ - D^K) ■ ve + iv 



=1. 



Rq 



Let (^(r) = r™, where r = |a;|, m is some positive integer sufficiently large. Through elementary 
computations, we get 



ifi — — 



2 

1 
2 



5^ {GQG^)^^x,x, 



m[m 



- 2)r"'-^ [GQG^).. XiXj + mr'^-'Tr [GQG^) 



mr'^^\f - D^K) ■ X + N 



> \nmim 

- 2 L V 



2) IICQG^I L + mTr (GQG^)] r"-^ - mr'"-2(/ - D^K) ■ x + N > C\ 



where C is a positive constant independent of i^o^ by condition (15.11) . For large enough m, we 
have 



-mTr (GQG^) r'"-^ _ ^(j _ ■ xr 



m-2 



PR 



< e 



< e 



™ Qnm(m + 1) \\GQG^\\^ Rl^'' + G"^ ^ pn 

Qnm(m + 1) \\GQG^\ ^ i^^"' + G"^ ao,R ^ ^{Ro 



The last inequality follows by the similar argument of (14.31) . Hence, 

d 
di 



I Cpr > -7(^o) -G' f Cpr. 
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This implies 



^0) f^^C'T _ ^ 



[ Cpn{x,T)>e~^'^ [ CaoA^) + ^(e 
>e'^'^ [ C^o,i?(x) 

+ - -^r^i^-nm{m + l)\\GQG^\\^Rl"'-' + C''^(l-e'''^) a,,n{x) (5.3) 



Let i?o — )■ oo, we have 



/ e-N'"p(x,r)>e-^'^ / 



e-l^l'-aolx) 



□ 



VI. Numerical simulations 
We give the numerical simulations of the ID cubic sensor: 

dxt = dvt 
dyt = x^dt + dwt, 

where xt, yt G M, Vt, Wt are scalar Brownian motion processes with E[dvfdvt] = 1, E[dwfdwt] = 
1. The ID Kolmogorov forward equation (|1.13l) here is 

1 1 . 

ut = -u^x - -jX u, (6.4) 
for each time step. The updated initial data is 

Ui{x,Ti) = e ^' 4 Ui-i{x,Ti). 

We adopt the Hermite spectral method to get the approximate solution Ui, for i = 0,1, ■ ■ ■ , k. p 
can be recovered by (|1.12l) . The expectation of the state xt is computed by definition 

E[x]{t) = /r^^^^'^)*^^ 
J^p{x,t)dx ' 

In Figure [T]|2l we see that Yau-Yau's algorithm tracks the state's expectation very well, while 
the extended Kalman filter completely fails. Take the efficiency into consideration, it costs only 
around 7.5 seconds for Yau-Yau's algorithm to simulate T = 10, while the extended Kalman filter 
takes around 3 seconds in our PC. We are expecting some speedup if a more powerful computer 
is used. The potential advantage of Yau-Yau's algorithm is that multi-core processors can speedup 
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Cubic sensor, initial data is u (x)=exp(-x /4) 















it °* 




k 





- real state 
EKF 

- Yau-Yau's algorithm 




Fig. 1. Comparison of Yau-Yau's algoritlim and extended Kalman filter for cubic sensor, with the initial condition uo{x) = e 



Cubic sensor, initial data is u (x) - exp(-x /4)*{1-sin(x)) 




Fig. 2. Comparison of Yau-Yau's algorithm and extended Kalman filter for cubic sensor, with the initial condition uo{x) = e 4(1 — sin x). 



further. For instance, if a dual-core processor is available, the computation of expectation of the 
state at the end of each time step can be handled by one processor, while the computation of 
the Fourier-Hermite coefficients is working on the other one. If more processors are provided, 
the first N Fourier-Hermite coefficients of the initial data at the beginning of each time step can 
be scattered to different processors and be computed simultaneously. In contrast with Yau-Yau's 
algorithm, the extended Kalman filter is only suitable programmed in sequential code, since the 
expectation and the covariance of the next time step are heavily relied on those of the previous 
time step. Even with multi-core processors, no speedup will be expected. 

Since we directly deal with the density function, all the higher central moments of the state 
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The 2 to 6 central moments of cubic sensor, with initial data u (x) = exp(-x /4) 



- E[(x-E[x^)'] 

- EKx-EIXj])"] 

- E[(x-E[x,])=] 

- E[(x-E[xJ)'=] 



^4 

Fig. 3. The 2"'' to 6"" central moments of the cubic sensor, with the initial condition uq(x) = e computed by Yau-Yau's algorithm. 



could be obtained by definition 

E[(x-E[x])'^](t) 



J^p{x,t)dx 

for any A; G Z+. As we known, EKF is essentially obtained by truncating the first two moments 
to get the approximation. While in our algorithm, we don't truncate any order of moments. In 
Figure [3l we plot the 2"'^ to 6"^ central moments of the cubic sensor with the initial condition 

uq{x) = e~^'^/^. 



Appendix 

Before we show the existence of the weak solution, we'd like to give a priori estimations of 
up to the first order derivative of the solution to the robust DMZ equation on Bji x [0, T]. 

Theorem A.l: Consider the robust DMZ equation (11.251) on Qi? := S^? x [0, T], where Br = 
{x G : |x| < i?} is a ball of radius R. Assume that 



< oo, 



(A.l) 



for all t e [0, T]. Suppose there exists a positive function g{x) on M" such that for all t e [0, T], 
g and g = g + log satisfies 



1) \D^g + ^V{GQG'^)-F\^ + 2XiJ <C, 



(A.2) 
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2) Dig + 2D^g ■ Vg + 2[V{GQG^) -F]-Vg+ IV^iGQC^) - divF + J < (A.3) 



3) Dl~g + 2D^^ ■ + 2[V(GQG^) - F] • + iV2(G'QG'^) - divF + J < C, (A.4) 



4) 4„e2%2^x)<C and j^^e^^D^a -Va < C, (A.5) 
where C is a generic constant, which may differ from line to line, and V(*) = Yll=i ^dx-^ ' 
V^(*) = EL.i Then, for < t < T, 

[ e'^^pl{x,t)dx<e^' [ e'^^a^{x)dx, (A.6) 
Jbr Jbr 

/ e^W^pnix, t) ■ Vpr(x, t)dx <e^* / e^W^a{x) ■ Va{x)dx + Ce^* / e^'3a^{x)dx, 

J Br J Br J Br 

(A.7) 

where and J{x,t) is defined in (12 .41) and (11.91) . respectively. 

Remark A. 1: The conditions in Theorem lA.ll are easily checked, if the drift terms h(x) and 
f{x) are at most polynomial growth in r = However, in general, the existence of such g is 
not always available. 

Proof: Let g be some positive function on M". 

^/ e'^pl= [ + 2 [ e^^F ■ p«) + 2 / e'^Jp% 

"I^ J Br J Br J Br J Br 

= 1 + II + III. (A.8) 

Apply integration by parts to I and II in (IA.8I) 

I = -2/" pne'W^g-VpR- f e^'D^pR-VpR- I e>^y(GQG^) ■ Vp^^ 

<-2 I pne'W^g -VpR- ! e^>^ prV{GQG^) ■ V Pr ^ Ii + I2. 

J Br J Br 

Integration by parts further, we have 

Ii =4 f e^^plD^g ■Vg + 2 [ e^'pnD^g ■VpR + 2 f e^3plV{GQG^) ■ Vg 
Jbr Jbr Jbr 

+ 2 [ e'^plDlg. (A.9) 

J Br 

Notice that the second term of the right-hand side of (IA.9I) is — Ii, we have 

11 = 2/" e'3plD^g-Vg+ ! e'a pWv^GQG'') -V g + Dig]. (A.IO) 
Jbr Jbr 
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The similar argument applies to I2: 



[ e'^plV{GQG^)-Vg + \j e>^V2(GQG^). (A.ll) 



Thus, 



I < / e^'pl 

J Br 



Dig + 2D^g ■ Vg + 2V{GQG^) ■ Vg + ^V^GQG^) 



(A.12) 



(A. 13) 



The same trick of Ii applies to II in (IA.8I) . we obtain 

II = - /" e^3pl[2F ■Vg + divF]. 
Jbr 

Substitute (IA.12I) and (IA.13I) back to (IA.8L we obtain 

< e^Vl \Dlg + 2D^g ■ Vg + 2[V{GQG^) -F]-Vg + ]^V\GQG^) - divF + j| 

<C j e^VL 
Jbr 

by condition (|A.3I) . (IA.6I) follows directly from Gronwall's inequality. To show (IA.7I) . we consider 

d 



dt 



J Br 

J Br f-^^ dt dXi dXj J Br (-^^ 



T\,,^ ( ^Pr\ 9pR 

dxi \ dt J dxj 



=IV + V. 



Due to condition (lA.ll) . IV of (IA.14I) turns out to be 



(A. 14) 



j^iGQG^] 



Br 



dp 
dxi 



R 



dpE 
dxi 



n 



j^{GQG^] 



B, 



<- 



n 



d 
di 



{GQG^ 



[ e^W^pR ■ VpR, 

J Br 



e''\VpR\' 
(A.15) 
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since D^p^ ■ V Pr > AilVp^p. Next, V in (IA.14I ) is 

V = - 2 e'ni'^D^g + V(GQG^)) ■ VpR + DIpr] ■ {^DIpr + F-VpR + Jpr^ 



Br 

\ DlpR + 



Br 



D^g + -V{GQG^) + F 



+ / e 

'Br 



29 



D^g + -V{GQG^)-F 



iVp^P 



- 2 / e'^lDlpR + {2D^g + V(GQG^)) ■ Vpr\Jpr 

JBn 

|Vp«P 

2 / e^^'iD^p^ + {2D^g + V(GQG'^)) ■ Vp^] Jp^. 

J Br 



<l e 

'Br 



D^g + -V{GQG^)-F 



(A.16) 



Notice that 



[ e^WlpRjpR = - [ e^^[2{D.^g-VpR)JpR + JD^pR-VpR 
Jbr Jbr 



+{Du,PR ■ VJ)pR + V{GQG^) ■ VprJpr] . (A.17) 



Take (|A.17I) into account, V becomes 



V < 



/..-I 




• 









1 2 



D^g+-V{GQG^)-F 



+ 1 



2j\d^Pr-Vpr + e^^\D^J\^pl. 



(A.18) 



Combine (IA.15I) and (|A.18I) . we have 

d 

'Br 



dt 



[ e^W^pR ■ VpR 

JBn 



=29 



+ 



D^g+U/{GQG'^)-F 



+ l)+2J) D^pR ■ Vp 



R 



+ ! e'^\D^J\'pl 
Jb„ 



(A. 19) 

□ 



By conditions (|A.2I) - (IA.5I) . the estimate (IA.7I) follows immediately. 
Proof of Theorem I2.3t Let be a sequence of positive number such that limfc__i.oo Rk = 00. 

Let pi:{x,t) be the solution of the robust DMZ equation (|1.25l) on Br^^ x [0,T], where Br^ = 
{x G M" : |x| < Rk} is a ball of radius Rk- In view of Theorem IA.1[ the sequence {pk} is a 
bounded set in Hq^{Qri^). Thus, there exists a subsequence {pfc'} which is weakly convergent 
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to p. Moreover, p has the weak derivative ^ G L^(Q^^), and weakly tends to it. Now we 



claim that the weak derivative ^ exists. To see this, let $(a;,t) G Hq^{Qr^), then 



'fc jj = l 



+ 



n / " 

EE 

.i=i \i=i 



d{GQa 
dxj 



lim // iy(GgG'^u.|i 



ax,; 



+ 



n / " 

EE 

.i=i \j=i 



— lim 



dpk' 
dt 



$ = lim 



fc'— >oo 



5$ 
dt 



dp 

djGQG^] 
dxj 

dt' 



Clearly, p{x, 0) = limfc/_,oo Pk'{x, 0) = o-o(x). 

To show the uniqueness of the solution, we only need to show that p{x, t) = on if 
p(x, 0) = 0. Let aT < 1. For any test function ip{x^t) = e'^'^^{x,t), where r = \x\, c is some 
constant and ^{x,t) G Hq'^{Qt), then p{x,t) satisfies 

a$ 



[ p{x,T)^{x,T)e"'dx- [ [ p{x,t)^{x,t)e'''dxdt 



1 c ~ 

--e'='^V$(x, f) ■ L'^p(x, t) - -e'='^<l>(x, t) Vr ■ D^p{x, t) + F(x, t) ■ Vp(x, t)e'^'^ 

+ J(x, t)<l>(x, t)e''''dxdt. (A.20) 
where F is defined in (12.21) . Approximate p{x,t) by in the i/^'^(Qr)-norm, we get 

p^{x,T)e'''dx 

/ e'^'^ [—Dyjp{x,t) -W p{x,t) — cp{x,t)Wr ■ Dyjp{x,t) 



+ t) + t)) ■ Vp{x, t)p{x, t) + 2 J(x, t)p^(x, t) 



dxdt. 



< [ e^^[-Ai|Vp(x,t)p-cp(x,t)D^r- Vp(x,t) 



+ {F{x, t) + F{x, t)) ■ Vp(x, t)p{x, t) + 2J(x, t)p^(x, t)]dxdt. 



Ai / e^'-<j|Vp(x,t)| + — [cD^r-(F(x,t) + F(x,t))]p(x,t)[> (ixcit 
+ / e""<j2J(x,t)-^[cD,„r-(F(x,t) + F(a;,t))]2}>p2(a;,t)cixdt 



< / e'''' {2J{x,t) - —[cD^r ~ {F{x,t) + F{x,t))f\ p^{x,t)dxdt, 



(A.21) 
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due to the positive definite of {GQG'^). By condition (12.11) . we have 

[ e^''p\x,T)dx <a [ e^'' p\x,t)dxdt. (A.22) 
According to the mean value theorem, there exists Ti G (0, T) such that 

[ e''''p\x,t)dxdt= [ [ e''''p\x,t)dxdt = T [ e"'' p\x,Ti)dx. (A.23) 
Apply (IA.22I) and (IA.23I) recursively, there exists T„ G (0,r) such that 

[ e'''p^ix,T)dx<iaT)"' [ e^' p\x,Tm)dx. 
Since aT < 1, we conclude that p(x, t) = for a.e (x, t) G Qt- D 
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